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@ Motion compensation encoding method and apparatus adaptive to motion amount 



) A motion compensating encoding apparatus 
adaptive to a motion amount adaptlvely gener- 
ates motion-compensated pixel values for per- 
forming differential pulse code nKxlulation of 
pixel values of a cunrent Image even when a 
current image motbn amount to be motion- 
compensated with respect to a reference image 
Is beyond a predetermined motion amount The 
motion oompensatk>n encoding apparatus in- 
cludes a global motion estimator (53) for 
generating a global motion vector representing 
spatial position difference between the refer- 
ence Image according to the pixel values stored 
in a first memory (17) and the current image 
according to the pixel values stored in a second 
memory (56), motion-compensating the refer- 
ence image on the basis of the generated global 
motion vector and storing the pixel values of the 
motion-compensated reference Image, a local 
motion estimator (54) for generating a local 
motion vector according to comparison of the 
pixel values between a current video block 
which Is formed by the pixel values supplied 
from the second memory (56), and which has a 
size smaller than the current image and a 
search area formed by part of the pixel values 
stored in the global motion estimator (53), a 
motion compensator (55) for receiving the local 
motion vector from the local motion estimator 
(54) and generating motion-compensated pbcel 
values by using the pixel values stored in the 
global motion estimator (53) and the local mo- 
tion vector, and a unit (31) for generating a 
difference value between the respective pixel 
values of each image secondly output from the 
second mentory (56) and the conresponding 
motion-compensated pixel values output from 
the motion compensator (55). 
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The present invention relates to a motion compensation encoding method which is adaptive to an amount 
of motion and the apparatus thereof, and more particularly, though not exclusively, to a motion compensation 
encoding method for use In a differential pulse encoded video signal capable of adaptlvely performing a motion 
compensation encoding operation even when an amount of motion between images is beyond a predetermined 
5 amount of motion. 

In a recent system, a video signal is usually encoded into digital data and then processed to improve a 
quality of the picture. However, when the video signal is encoded into the digital data, an amount of data be- 
comes considerably large. To solve such a problem, a conventional video encoding system utilizes a transfor- 
mation encoding method, a differential pulse code modulation (DPCM) method, a vector quantization method 

10 and a variable length coding (VLC) method, thereby removing redundancy data included in a digital video signal 
to reduce an amount of the total data. Referring to Figure 1, a conventional motion image encoder having a 
well-known structure will be described below. 

One frame digital video signal is reconstructed as M x N pixels. Pixel values of the reconstructed video 
blocks are stored in memory 10. The pixel values stored in memory 10 are applied to a motion estimator 18, 

IS a subtracter 31 and a ratio controller 20. Motion estimator 18 uses pixel values of a current image supplied 
from memory 10 and pixel values of a reference image stored in a frame memory 17, to estimate an amount 
of motion with respect to the respective video blocks of the current Image. Motion estimation is performed on 
the basis of correlation between frames. Motion estimator 18 finds a reference video block having image in- 
formation nearly identical to that of a current video block used for comparison in a search area which becomes 

20. a part of the reference Image, to then generate a motion vector MV representing a spatial position difference 
between the current video block and the reference video block. A motion compensator 19 reads pixel values 
of the reference video block which is designated by motion vector MV produced by motion estimator 1 8. from 
frame memory 1 7. The read pbcel values are output to subtracter 31 . Subtracter 31 subtracts a corresponding 
pixel value applied from motion compensator 19 from a pixel value supplied from memory 10 for a differential 

25 pulse code modulation and outputs a differential pixel value obtained by substraction to a transformer 11 . A 
transformer 11 transforms spatial region pixel values supplied from subtracter 31 into frequency region trans- 
form coefficient values. Transformer 11 uses one among a discrete cosine transform (DCT) method, a Walsh- 
Hadamard transform (WHT) method, a discrete Fourier transfomn (DFT) method or a discrete sine transform 
(DST) method, to perform a transform operation in units of a video block having M x N pixels. The transform 

30 coefficient values output from transformer 11 are quantized by a quantizer 12 to then be supplied to a variable- 
length coder 13 and an inverse quantizer 15. Quantizer 12 and inverse quantizer 15 quantizes and inverse- 
quantizes respectively the input data according to a quantization control signal Qss applied from ratk) controller 
20. 

Since technologies in connection with quantizer 12 and inverse quantizer 15 are well known, detailed de- 

35 scripttons thereof will be omitted. Variable-length coder 13 variable-length-codes the input data. A buffer 14 
temporarily stores the data output from variable-length coder 1 3 prior to being transmitted, and outputs a buffer 
fullness representing a storage state of buffer 14 to ratio controller 20. Ratio controller 20 generates a control 
signal Qss for quantization on the basis of the pixel values supplied from memory 10 and the buffer fullness 
applied from buffer 14. On the other hand an inverse transfonner 18 performs an inverse transfonn of the trans- 

40 form coefficient values applied from inverse quantizer 15 with respect to the transform by transformer 11, to 
generate spatial region pixel values. An adder 32 adds pixel values applied from motion compensator 19 and 
pixel values applied from inverse transformer 16, to then output the result to frame memory 17. Frame memory 
17 stores the pixel values applied from adder 32. The quantization control signal generated by ratio controller 
20, motion vector MV generated by motion estimator 1 8 and output data Vc of buffer 14 are supplied to a video 

45 decoder shown in Figure 2. Switches 33 and 34 are used for reducing the difference between an image prior 
to being encoded by differential pulse code modulation in the motion picture encoder shown in Figure 1 and 
an image after decoding in the decoder shown in Figure 2. 

In the motion decoder of Figure 2, variable-length decoder 21 variable-length-decodes data Vc output from 
buffer 14. An inverse quantizer 22 and in inverse transformer 23 perfonn the same function as those of inverse 

50 quantizer 15 and inverse transformer 16 of Figure 1 , respectively. Motion compensator 24 reads pixel values 
from frame memory 25 corresponding to motion vector MV to supply the read pixel values to an adder 26. Adder 
26 adds the output data of motion compensator 24 to the output data of inverse transformer 23, to output the 
result to a display and frame memory 25. Aswitch 27 is used for the same purpose as those of above switches 
33 and 34. 

55 Since the motion image encoder shown in Figure 1 uses a search area composed of the number of pixels 

smaller than one frame to find a reference video block having the same image information as that of a current 
video block, a reference video block having the same image information as that of the cun'ent video block does 
not exist in a given search area, In case of a fast moving picture or a whole faning picture such as sports. The 
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Figure 1 motion image encoder does not perform a non-intracoding operation which obtains a difference value 
between image frames by using differential pulse code modulation with respect to the current video block, but 
performs an intracoding operation. Accordingly, an amount of bits of the encoded data becomes large. Such 
a problem lowers a total quality of picture and heightens a probability of occurrence of an overflow in buffer 
5 14. In a system by a predetermined data standard which uses a proper combination of an intracoding and a 
non-intracoding. 

It is an aim of preferred embodiments of the present invention to provide a motion compensation encoding 
method which estimates an amount of motion with respect to a video block to be motion-compensation-en- 
coded and Is adaptive to an amount of motion for generating the motion-compensated data, In which a global 
10 motion vector representing displacement between the frames is generated by altering a motion estimation 
range Into a whole frame in case of an Image having a large amount of motton between frames, and using 
data of the frame motion-compensated by the generated global motion vector. 

It is another aim of preferred embodiments of the present invention to provide an apparatus embodying 
the aforementioned method. 

15 It is still another aim of preferred embodiments of the present invention to provide a motion compensation 
encoding apparatus which is adaptive to an amount of motion for generating motion-compensated data by gen^ 
erating a reference image which is obtained by compensating spatial position difference between an Image 
to be motion-compensated and an image which becomes a reference of motion compensation. 

According to a first aspect of the present Inventton, there is provided a motion compensation encoding 
20 apparatus for use in an image encoder for perfonming differential pulse code modulation by using pixel values 
of a current Image and motton-compensated pixel values, the motion compensation encoder comprising: 
a first memory for storing pixel values of a reference image; 

a second memory for storing pixel values with respect to a plurality of Images, and repetitively outputting 
the stored pixel values of each image one-frame by ohe-f reme at least twice; 
25 global motion estimation means for generating a global motion vector representing spatial position dif- 

ference between the reference image according to the pixel values stored in the first memory and the current 
image according to the pixel values stored In the second memory, motfon-compensating the reference image 
on the basis of the generated global motion vector and storing the pixel values of the motion-compensated 
reference image; 

30 local motion estimation means for generating a local motion vector according to comparison of the pixel 

values between a current video block which is formed by the pixel values supplied from the second memory, 
and which has a size smaller than the current image and a search area formed by part of the pixel values stored 
in the global motion estimation means; 

motion compensation means for receiving the local motion vector from the local motion estimation 

35 means and generating motion-compensated pixel values by using the pixel values stored In the global motion 
estimation means and the local motk>n vector; and 

means for generating a difference value between the respective pixel values of each image secondly 
output from the second memory and the corresponding motion-compensated pbcel values output from the mo- 
tion compensation means. 

40 Suitably, said global motion estimator generates said local motion vector on the basis of a mean absolute 
enror value according to pbcel difference values between a plurality of a respectively moved current image ob- 
tained by movement within the motion estimation range and the reference image. 

Suitably, said global motion estimator generates said local motion vector on the basis of a mean square 
error value according to pixel difference values between a plurality of a respectively moved current image ob- 
45 talned by movement within the motion estimation range and the reference image. 

According to a second aspect of the present invention, there is provided a motion compensation encoding 
apparatus for use in an image encoder for perfomiing differential pulse code modulation by using pixel values 
of a current image and motion-compensated pixel values, the motion compensation encoder comprising: 
a first memory for storing pixel values of a reference image; 
50 a second memory for storing pixel values with respect to a plurality of images, outputting the stored 

pixel values of each image one-frame by one-frame, and outputting again the pixel values of each image output 
one-frame by one-frame once or twice more on the basis of a first control signal; 

motion disaimination means, coupled to receive the firstly output one-frame pixel values among the 
duplicate pixel values of the same image output from the second memory, for discriminating whether an amount 
55 of motion of the current image according to the pbcel values supplied from ttie second memory with respect 
to the reference image according to the pixel values stored in the f iret memory, is beyond a predetermined 
amount of motion, and generating first and second control signals according to the discrimination result; 

global motion estimation means for generating a global motion vector representing spatial position dif- 



3 



EP 0 689 359 A2 



ference between the reference image according to the pixel values stored In the first memory and the cun-ent 
image acconling to the pixel values stored in the second memory, and storing the pixel values of the motion- 
compensated reference image on the basis of the generated global motion vector; 

local motion estimation means for discriminating whether the motion-compensated reference Image is 

5 stored in the global motion estimation means, and generating one of a first local motion vector according to 
comparison of the pixel values between a current video block which is formed by the pixel values supplied from 
the second memory, and which has a size smaller than the cunrent image and a first search area formed by 
part of the pixel values stored in the first memory, and a second local motion vector according to comparison 
of the pixel values between the current video block and a second search area formed by part of the pbcel values 

10 stored In the global motion estimation means, on the basis of the discrimination result; 

switching means for outputting the pixel values supplied from the second memory to the local motion 
estimation means if the second control signal generated int he motion discrimination means represents that 
the cun^nt image motion amount is not beyond the predetermined motion amount, outputting one-frame pixel 
values among the pixel values oft eh same image supplied from the second memory, if the second control 

15 signal represents that the current image motion amount is beyond the predetermined motton amount, and out- 
putting the following one-frame pixel values to the local motion estimation means; 

motion compensation means for generating motion-compensated pixel values by using the pixel values 
stored in the first memory and the first local motion vector if the first local motion vector is applied from the 
local motion estimation means, and generating motion-compensated pixel values stored In the global motion 

20 estimation means and the second local motion vector, if the second local nwtton vector is applied from the 
local motion estimation means; and 

means for generating a difference value between the respective pixel values of each Image output from 
the second memory and the corresponding nnotion-compensated pixel values output from the motion compen- 
sation means. 

25 Suitably, said second memory outputs the pixel values of the cun-ent image one-frame by one-frame twice 
if the first control signal represents that the cunrent image motion amount is beyond the predetermined motion 
amount, while said second memory outputs the pixel values of the current image of only one frame if the first 
control signal represents that the former is not beyond the latter. 

Suitably, said motion discriminator generates the first control signal according to a result whether the first 
30 reference video block having the same image Infonnation as that of the current vkleo block exists in the first 
search area corresponding to the current video block. 

Suitably, said motion discriminator discriminates whether the first reference video block having the same 
image information with respect to a plurality of the cunrent video block exists in the cunrent image. 

Suitably, sa\6 global motion estimator generates said first local motton vector on the basis of a mean ab- 
35 solute em)r value according to pixel difference values between a plurality of a respecth^ely moved current im- 
age obtained by movement within the motion estimation range and the reference image. 

Suitably, said global motton estimator generates said first local motion vector on the basis of a mean square 
error value according to pixel difference values between a plurality of a respectively moved current image ob- 
tained by movement within the motion estimation range and the reference image. 
40 Suitably, said local motion estimator generates said first local motion vector If the motion-compensated 
reference image is not stored in said global motion estimator, while the fonmer generates sakl second local 
motion vector if the motion-compensated reference image is stored in said latter. 

According to a third aspect of the present invention, there Is provided a motion compensation encoding 
method for use in an image encoder for performing differential pulse code modulation by using pixel values 
45 of a current image and motion-compensated pixel values, the motion compensation encoding method conv 
prising the steps of: 

a) storing pixel values of a reference image for motton compensation; 

b) storing pixel values of the cunrent image; 

c) discriminating whether an amount of motion of the cun-ent Image to be motion-compensated is beyond 
50 a predetermined amount of motion on the basis of all the pixel values stored in steps a) and b); 

d) generating a global motion vector representing spatial position difference of the current image of the 
pixel values stored in step b) with respect to the reference image of the pixel values stored in step a), if a 
discrimination result of step c) represents that the cun-ent image motion amount is beyond the predeter- 
mined motton amount; 

55 e) motion-compensating the reference image corresponding to the pixel value stored in step a) to store 
the pbcel values of the motion-compensated reference image; 

f) generating a second local motion vector on the basis of comparison of pixel values between a first video 
block and a second search area formed by part of the pbcel values stored in step e); 
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g) generating motlon-compensated pixel values by using the second local motion vector generated In step 
f) and the corresponding pixel values stored in step e); and 

h) generating a difference value between the respective pixel values of the current Image stored In step 
b) and the corresponding pixel values of the motion-compensated reference image generated in step g). 
Suitably, said method further comprises the steps of: 

I) generating a first local motion vector on the basis of comparison of the pixel values between the first 
video block which is fonned by the pixel values stored in step b) and having a smaller size than that of the 
current image and a f Iret search area formed by a part of the pixel values stored in step a); 
j) generating the motion-compensated pixel values using the first local motion vector generated In step I) 
and the corresponding pixel values stored In step a); and 
k) generating a difference value between the respective pixel values of the current Image stored in step 
b) and the corresponding pixel values of the motion-compensated reference image generated in step j), 
wherein a discrimination result of step c) represents that the cunrent image motion amount is not beyond 
the predetermined motion amount. 
15 Suitably, said step c) comprises the sub-steps of: 

c1) fomnlng the first search area for motion estimation of the cun-ent video block, and including the current 
video block having a part of the current image pixel values and a part of the pixel values stored in step a); 
c2) discriminating whether the reference video block having the same image information as that of the cur- 
rent video block exists In the f iret search area on the basis of comparison of the image information between 
the cun-ent video block pixel values formed in sub-step d) and the corresponding blocks which exist In the 
f iret search area and having the same number of pixels as that of the cun-ent video blocfc and 
discriminating whether the cun-ent image motion amount is beyond the predetermined motion amount 
on the basis of the discrimination result of sub-step c2). 

Suitably, said sub-step c2) further comprises the sub-step of discriminating whether the first reference vid- 
eo block having the same Image Infonnation with respect to a plurality of the current video blocks exists in the 
current Image. 

Suitably, said step d) further comprises the sub-step of d1) generating the global motion vector on the basis 
of a mean absolute error value according to pixel difference values between a plurality of a respectively moved 
current image obtained by movement of the current image within the predetemiined motion estimation range 
30 and the reference image. 

Suitably, sub-step d1) comprises the sub-step of dal) calculating the mean absolute error value of the pixel 
difference values between one cunrent Image by movement using the following equation and the reference 
Image, 



W H 



MV(k, 2) = min Jj^ \Y^,(m^k\n- 1) -y„^(/n./3) | . , 

-x_rang s k s x_rang-l, 
-y_rang sis y_rang-l (i) . 

In which Ycu,<m. n) represents the (m. n)^ pixel value in the current image, and Y,^m, n) represents the 
(m. nr pixel value in the reference image, charactere W and H represent the number of horizontal and vertical 
pixels, respectively, and expressions x^rang and y.rang represent a movement range of the current image 
with respect to the reference Image in the horizontal and vertical directions, respectively. 

Suitably, step d) further comprises the sub-step of d2) generating the global motion vector on the basis 
of a mean square error value according to pixel difference values between a plurality of a respectively moved 
current image obtained by movement of the current image within the predetermined motion estimation range 
and the reference image. 

Suitably, said sut^step 62) comprises the sub-step of da2) calculating the mean square error value of the 
pixel difference values between one current Image by movement using the following equation and the refer- 
55 ence image. 
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W H 



MV(k, 1) = min 




-x_rang s k s x_rang-l, 
-y_rang sis y_rang-l 



(2) . 



in which Ycu^m, n) represents the (m, ny^ pixel value in the current Image, and Yr^m, n) represents the 
(m, n)^ pixel value in the reference image, characters W and H represent the number of horizontal and vertical 
pixels, respectively, and expressions x_rang and y.rang represent a movement range of the current image 
with respect to the reference image in the horizontal and vertical directions, respectively. 

Prefen-ed embodiments of the present invention are described, by way of example only, with reference to 
the drawings, wherein: 

Figure 1 is a block diagram showing a conventional Image encoding system. 

Figure 2 is a block diagram showing a conventional innage decoding system. 

Figure 3 is a block diagram showing a nrwtion compensating encoding apparatus according to a preferred 
embodiment of the present invention. 

Figures 4A and 4B show a motion compensation encoding method which is adaptive to an amount of motion 
according to the present invention. 

A prefen-ed embodiment of the present invention will be described below in more detail with reference to 
the accompanying drawings Figures 3, 4A and 4B. 

Figure 3 shows a motion compensation encoder according to a preferred embodiment of the present in- 
vention. In Figure 3. the like elements to Figure 1 use the like reference numerals thereto and the detailed 
description thereof will be omitted. 

A construction and operation of the Figure 3 apparatus will be described below in connection with the pres- 



A memory 56 stores pixel values of a plurality of images. Memory 56 outputs the pixel values of a previous 
Image among the stored pixel values to a ratio controller 20 and a subtracter 31, and outputs the pixel values 
of a current image to motion discriminator 51 . Subtracter 31 subtracts the conresponding pixel values supplied 
from motion compensator 65 from the respective pixel values of the previous image supplied from memory 
31 and outputs a difference value to a transformer 11 . 

On the other hand, motion estimator 51 receives the pixel values of the reference image stored in a frame 
memory 17 if the pixel values of the current image is supplied from memory 56 and discriminates an amount 
of motion of the current image with respect to the reference inr«ge. To discriminate the amount of motion of 
the current image with respect to the reference image, motion discriminator 51 discriminates whether a firet 
reference video block having the same image information as that of a cunnent video block which becomes a 
part of the current image exists in a first search area with respect to one or more current video blocks. Motion 
discriminator 51 generates a first control signal CTL1 representing whether motion estimation of the current 
image Is possible using the pixel values of the reference image on the basis of the detection result. Motion 
discriminator 51 generates a second control signal CTl^ on the basis of the above discrimination result If firet 
control signal CTL1 represents that the motion estimation of the current image is possible using the pixel values 
of the reference image, memory 56 supplies the pixel values of the current image to a switch 52. Memory 56 
supplies the pbcel values of the current Image again to a subtracter 31 after all the pixel values of the current 
image are supplied to switch 52. Switch 52 supplies the pixel values of the current Image supplied via an input 
end C from memory 66 to a local motion estimator 54 via a first output end A. according to the applied second 
control signal CTL2. Local motion estimator 54 discriminates whether the pixel values of the compensated ref- 
erence image are stored in global motion estimator 53. If the pixel values of the compensated reference image 
are not stored in global motion estimator 53 as a discrimination result, local motion estimator 54 uses the pixel 
values of the reference image stored in frame memory 17 and the pixel values of the current image applied 
via switch 52. and generates a first local motion vector LMV1 with respect to a current video block. 

The generation of the firet local motion vector LMV1 will be described below with reference to Figure 4A. 
In Figure 4A, first local motion vector LMV1 is detenmlned on the basis of the cun-ent video block within the 
current image and the firet search area within the reference image. Here, the first search area has a smaller 
number of pbcels than that of the reference image, and has a position on an image corresponding to the cun-ent 
video block. In Figure 4A, the current video block is represented as a hatched rectangular shape, and the firet 
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reference video block having the same Image Information as that of the current video block Is represented as 
a hatched rectangular shape. Local motion estimator 54 compares a corresponding block having the same 
number of pixels as that of the current video block and which is located on the left-upper end In the first search 
area and all blocks which are obtained by moving the corresponding block one-pixel by one-pixel to the right 

5 direction and/or to the down directfon with the current video block. A method used for comparison Is a well- 
known mean absolute enor (MAE) method or mean square error (MSE) method. If the first reference video 
block having the least difference value from the current video block is determined by comparison of the pixel 
values of the MAE or MSE. local motfon estimator 54 generates a first local motion vector LMV1 representing 
spatial position difference between the first reference video block and the current video block. First local motion 

10 vector LMV1 is produced with respect to the respective current video blocks and the produced first motion vec- 
tor LMV1 is supplied to motion compensator 55. 

Motion compensator 55 discriminates that the pixel values of the compensated reference image are not 
stored in global motion estimator 53, If first motion vector LMV1 is applied from motion estimator 54. Based 
on such discrimination, motion compensator 55 generates the motion-compensated pixel values according to 

15 the pixel values of the reference image stored in frame memory 17 and the first local motion vector I-MV1 gen- 
erated in motion estimator 54. Subtracter 31 subtracts the corresponding pixel values supplied from motion 
compensator 55 from the respective pixel values of the current image supplied from memory 56 and outputs 
the difference value obtained by subtraction to transformer 11. The pixel values output from motion compen- 
sator 55 are also supplied to an adder 32, by which is added to the data output from inverse transformer 16.' 

20 The pixel values obtained by adder 32 are stored in frame memory 1 7 and used as the pbcel values of the ref- 
erence image for motion-compensating the following image. 

If first control signal CTL1 generated in motion discriminator 51 represents that motion estimation of the 
current image is not possible using the pixel values of the reference image, memory 56 repetitively supplies 
the pixel values of the current image one-frame by one-frame twice to switch 52. After memory 56 repetitively 

25 supplies the pixel values of the current image twice to switch 52. the pixel values of the current image are also 
supplied to subtracter 31 . Switch 52 supplies the pixel values of firstly input one-frame current image among 
the pixel values of the two-frame current image supplied via input end C from memory 56 according to the 
applied second control signal CTI-2. via a second output end B to local motion estimator 54. Then, switch 52 
supplies the pixel values of the secondly applied cunrent image via first output end A to local motion estimator 

30 54. Local motion estimator 54 does not generate a local motion vector during the time when the pixel values 
of the current image are not supplied via switch 52. Subtracter 31 does not operate as well since the pixel values 
of the current image from memory 56 and the motton-compensated pixel values from motion compensator 55 
are not supplied thereto. 

Global motion estimator 53 generates a global motion vector GMV representing spatial position difference 
35 of the current image with respect to the reference image by using all the pixel values of the current image ap- 
plied from second output end B of switch 52 and all the pixel values of the reference image stored in frame 
memory 17. Global motion estimator 53 uses one among the following equations (1) according to the MAE 
method or following equation (2) according to the MSE method, to generate global motion vector GMV. The 
relationship between the reference image and the compensated reference image is conceptually shown in Fig- 
40 ure 4B. As can be seen from Figure 48, global motion vector GMV represents the spatial position difference 
of the current image with respect to the reference image. 

W H 

45 V 

-x_rang s k s x_rang-l, 

so 

-y_rang sis y_rang-l (i) . 
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Here. Ycur(m. n) represents the (m, n)* pixel value In the current Image, and YreKm, n) represents the (m. 
n)«^ pixel value in the reference image. Characters W and H represent the number of horizontal and vertical 
pixels, respectively. Expression x_rang and y_rang represent a movement range of the current image with re- 
spect to the reference image in the horizontal and vertical directions, respectively. That is, the cun-ent image 
15 can have a position with respect to the reference Image within the range from -x_rang to x_range-1 of the ref- 
erence Image In the horizontal direction. This Is also same as that in the vertical direction. As shown in Figure 
4B, global motion estimator 53 receives and stores the pixel values of the compensated reference image having 
a reference position moved from frame memory 17. by moving a position of the reference image by global mo- 
tion vector GMV. Actually. In case of pixels to be added to a newly compensated reference frame by movement 
20 of the reference frame among the pixel values of the compensated reference frame stored In global motion 
estimator 53. ail pixel values are established into any one of the same values. Such a value can be set to a 
specif ic value of "0" or "255" In case of a pixel value representing 256 gradation. 

After global motion vector GMV and the compensated reference image have been completely determined 
by global motion estimator 53. the pixel values of the cun-ent image supplied from memory 56 are supplied 
25 via switch 52 to local motion estimator 54. Local motion estimator 54 determines whether the pixel values of 
the compensated reference image are stored In global motion estimator 53, if the pixel values of the current 
Image are applied via f iret output end A of switch 52. If global motion estimator 53 stores the pbtel values of 
the compensated reference image according to the discrimination result, local motion estimator 54 uses the 
pixel values of the compensated reference Image stored in global motion estimator 53 and the pixel values of 
30 the current Image applied via switoh 52, to generate a second local motion vector LMV2 with respect to the 
cun-ent video block. Since a generation process of second local motion vector LMV2 In local motion estimator 
54 is similar to that of motion estimator 18 which detenmines the first reference video block with respect to the 
cun-ent video block by using the pbcel values stored in frame memory 17, the generation process thereof will 
be omitted. 

35 Local motion estimator 54 compares the pbcel values of the current video block with the pixel values in a 
second search area of the compensated reference frame, and detenmines a second reference video block in 
the second search area having the same image infonmation as that of the current video block. Here, the second 
search area has a position which Is moved by a value of global motion vector GMV from the first search area 
as shown in Figure 4B, and has a position corresponding to the cun-ent video block used for comparison within 

40 the compensated reference image as well. Local motion estimator 54 generates second local motion vector 
LMV2 representing spatial position difference between the current video block and the second reference video 
block, if the second reference video block is detemiined. The generated second local motion vector LMV2 is 
supplied to motion compensator 55. 

Motion compensator 55 uses the pixel values of the compensated reference image stored in global motion 

45 estimator 53 and the second local motion vector LMV2 to obtain the motion-compensated pixel values with 
respect to the current video block if the second local motion vector LMV2 is applied thereto, and then outputs 
the obtained pixel values to subtracter 31 and adder 32. Subtracter 31 subtracts the motion-compensated pixel 
values supplied from motion compensator 55 from the pixel values of the current image supplied from memory 
56. Thereafter, since operation of the Figure 3 apparatus is the same as the motion compensation operation 

50 using the first local motion vector LMVl, the detailed description thereof will be omitted. The global motion vec- 
tor GMV and local motion vector LMVl or LMV2 generated in the Figure 3 apparatus are transmitted to a de- 
coder (not shown) for decoding the motion-compensated encoded image. 

In the case of the above-described embodiment, the apparatus of Figure 3 operates on the basis of the 
control signals according to the discrimination of motion discriminator 51. It is, however, possible to provide 

55 other variations which are obtained by removing motion discriminator 51 and switch 52. The modified embodi- 
ment will be briefly described below referring to Figure 3. 

If memory 56 outputs the pixel values of the current image, global motion estimator 53 generates a global 
motion vector of the cun-ent Image with respect to the reference image in the same manner as that described 
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referring to Figure 3. Global motion estimator 53 uses the generated global motion vector, motion-compensates 
the reference Image, and stores the pixel values of the motion-compensated reference image. 

Motion estimator 54 generates a local motion vector on the basis of the motion-compensated reference 
image stored in global motion estimator 53 and the pbcel values of the current image applied from memory 

5 56. Motion compensator 54 uses the local motion vector and the pixel values stored in global motion estimator 
53, to generate the motion-compensated pixel values. Thus, motion compensator 54 can generate the motion- 
compensated pixel values properly as well when an amount of motion of the current image with respect to the 
reference Image is beyond a predetermined motion amount. 

As described above, the motion compensation encoder adaptive to an amount of motion according to the 

10 present invention can determine a motion vector with respect to the respective video blocks in the current im- 
age, even when motion vectors with respect to the respective video blocks in the current image cannot deter- 
mine using the search area determined in the reference image. Thus, a problem of increasing an amount of 
the transmission data occurring in the conventional motion compensation encoding system which performs 
an intracoding operation because of no determination of the motion vector with respect to an Image having a 

IS large amount of motion, can be solved. 

White only certain embodiments of the invention have been specifically described herein, it will be appa- 
rent that numerous modifications may be made thereto without departing from the spirit and scope of the in- 
vention. 

The reader's attention is directed to all papers and documents which are filed concurrently with or previous 
20 to this specification in connection with this application and which are open to public inspection with this spec- 
ification, and the contents of all such papers and documents are incorporated herein by reference. 

All of the features disclosed in this specification (including any accompanying claims, abstract and draw- 
ings), and/or all of the steps of any method or process so disclosed, may be combined in any combination, 
except combinations where at least some of such features and/or steps are mutually exclusive. 
25 Each feature disclosed in this specification (including any accompanying claims, abstract and drawings), 

may be replaced by alternative features serving the same, equivalent or si milar purpose, unless expressly stat- 
ed otherwise. Thus, unless expressly stated otherwise, each feature disclosed is one example only of a generic 
series of equivalent or similar features. 

The invention is not restricted to the details of the foregoing embodiment(s). The invention extends to any 
30 novel one, or any novel combination, of the features disclosed in this specification (including any accompa- 
nying daims, abstract and drawings), or to any novel one, or any novel combination, of the steps of any method 
or process so disclosed. 



35 Claims 



1. A motion compensation encoding apparatus for use in an image encoder for perfbnning differential pulse 
code modulation by using pixel values of a current image and motion-compensated pbcet values, said mo- 
tion compensation encoder comprising: 
40 a first memory (17) for storing pixel values of a reference image; 

a second memory (56) for storing pixel values with respect to a plurality of images, and repetitively 
outputting the stored pixel values of each image one-frame by one-frame at least twice; 

global motion estimation means (53) for generating a global motion vector representing spatial pos- 
ition difference between the reference image according to the pixel values stored in the first memory (17) 
45 and the current image according to the pixel values stored in the second memory (56), motion-compen- 

sating the reference image on the basis of the generated global motion vector and storing the pbcel values 
of the motion-compensated reference image; 

local motion estimation means (54) for generating a local motion vector according to comparison 
of the pixel values between a cun-ent video block which Is formed by the pixel values supplied from the 
so second memory (56). and which has a size smaller than the current image and a search area fonmed by 

part of the pixel values stored in the global motion estimation means (53); 

motion compensation means (55) for receiving the local motion vector from the local motion esti- 
mation means (54) and generating motion-compensated pixel values by using the pixel values stored in 
the global motion estimation means (53) and the local motion vector; and 

means (31) for generating a difference value between the respective pixel values of each image 
secondly output from the second memory (56) and the corresponding motion-compensated pbcel values 
output from the motion compensation nteans (55). 
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2. A motion compensation encoding apparatus according to daim 1 , wherein said global motion estimator 
(53) generates said local motion vector on the basis of a mean absolute enror value according to pixel 
difference values between a plurality of a respectively moved current image obtained by movement within 
the motion estimation range and the reference image. 

3. Amotion compensation encoding apparatus according to claim 1. wherein said global motion estimator 
(53) generates said local motion vector on the basis of a mean square error value according to pixel dif- 
ference values between a plurality of a respectively moved current image obtained by movement within 
the motion estimatbn range and the reference image. 

4. Amotion compensation encoding apparatus for use in an image encoder for performing differential pulse 
code modulation by using pixel values of a current image and motion-compensated pixel values, said mo- 
tion compensation encoder comprising: 

a first memory (17) for storing pixel values of a reference image; 

a second memory (56) for storing pixel values with respect to a plurality of images, outputting the 
stored pbcel values of each image one-frame by one-frame, and outputting again the pixel values of each 
image output one-frame by one-frame once or twice more on the basis of a first control signal; 

motion discrimination means (51), coupled to receive the firstly output one-frame pixel values 
among the duplicate pixel values of the same image output from the second memory (56), for discrimin- 
ating whether an amount of motion of the current image according to the pixel values supplied from the 
second memory (56) with respect to the reference image according to the pixel values stored in the first 
memory (17), is beyond a predetermined amount of motion, and generating first and second control sig- 
nals according to the discrimination result; 

global motion estimation means (53) for generating a global motion vector representing spatial pos- 
ition difference between the reference image according to the pixel values stored in the first memory (17) 
and the current image according to the pixel values stored In the second nwmory (56), and storing the 
pbcel values of the motion-compensated reference image on the basis of the generated global motion vec- 
tor 

local motion estimation means (54) for discriminating whether the motion-compensated reference 
image is stored in the global motion estimation means (53), and generating one of a first local motion 
vector according to comparison of the pixel values between a current video block which is formed by the 
pbcel values supplied from the second memory (56), and which has a size smaller than the current image 
and a first search area formed by part of the pixel values stored in the first memory (17), and a second 
local motion vector according to comparison of the pixel values between the current video block and a 
second search area fbnmed by part of the pixel values stored in the global motion estimation means (53), 
on the basis of the discrimination result; 

switohing means (52) for outputting the pixel values supplied from the second memory (56) to the 
local motion estimation means (54) if the second control signal generated in the motion discrimination means 
(51) represents that the current image motion amount is not beyond the predetenmined motion amount, out- 
putting one-frame pbcel values among the pixel values of the same Image supplied from the second memory 
(56), if the second control signal represents that the current innage motion amount is beyond the predeter- 
mined motion amount, and outputting the following one-frame pixel values to the local motion estimation 
means (54); 

motion compensation means (55) for generating motion-compensated pbcel values by using the pix- 
el values stored in the first memory (17) and the first local nrwtion vector if the first local motion vector is 
applied from the local motion estimation means (54), and generating motion-compensated pixel values 
stored In the global motion estimation means (53) and the second local motion vector, if the second local 
motion vector is applied from the local motion estimation means (54); and 

means (31) for generating a difference value between the respective pbcel values of each Image 
output from the second memory (56) and the corresponding motion-compensated pbcel values output from 
the motion compensation means (55). 

5, A motion compensation encoding apparatus according to claim 4, wherein said second memory (56) out- 
puts the pixel values of the current image one-frame by one-frame twice if the first control signal repre- 
sents that the current image motion amount is beyond the predetenmined motion amount, while said secr 
ond memory (56) outputs the pixel values of the current image of only one frame if the first control signal 
represents that the former is not beyond the latter. 



10 



EP0 689 359 A2 

6. Amotion compensation encoding apparatus according to claim 4 or claim 5, wherein said motion discrim- 
inator generates the first control signal according to a result whether the first reference video block having 
the same image information as that of the current video block exists In the first search area corresponding 
to the current video block. 

5 

7. A motion compensation encoding apparatus according to any of claims 4 to 6, wherein said motion dis- 
criminator discriminates whether the first reference video block having the same image information with 
respect to a plurality of the current video block exists in the current image. 

8. Amotion compensation encoding apparatus according to any of claims 4 to 7, wherein said global motion 
estimator (53) generates said first local motion vector on the basis of a mean absolute error value ac- 
cording to pixel difference values between a plurality of a respectively moved current image obtained by 
movement within the motion estimation range and the reference image. 
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9. Amotion compensation encoding apparatus according to any of claims 4 to 7. wherein said global motion 
estimator (53) generates said first local motion vector on the basis of a mean square errorvalue according 
to pixel difference values between a plurality of a respectively moved current image obtained by move- 
ment within the motion estimation range and the reference image. 

10. A motion compensation encoding apparatus according to any of claims 4 to 9, wherein said local motion 
estimator (54) generates said first local motion vector If the motion-compensated reference Image Is not 
stored in said global motion estimator (53), while the former generates said second local motion vector 
if the motion-compensated reference image is stored in said latter. 

11- A motion compensation encoding method for use in an Image encoder for performing differential pulse 
code modulation by using pixel values of a cunrent Image and motion compensated pixel values, said mo- 
tion compensation encoding method comprising the steps of: 

a) storing pixel values of a reference Image for motion compensation; 

b) storing pixel values of the current image; 

c) discriminating whether an amount of motion of the current image to be motion-compensated is be- 
yond a predetermined amount of nnotlon on the basis of all the pixel values stored in steps a) and b); 

d) generating a global motion vector representing spatial position difference of the current image of 
the pixel values stored in step b) with respect to the reference image of the pixel values stored in step 

a) , if a discrimination result of step c) represents that the current image motion amount is beyond the 
predetemilned motion amount. 

e) motion compensating the reference image corresponding to the pixel values stored in step a) to store 
the pixel values of the motion-compensated reference Image; 

f) generating a second local motion vector on the basis of comparison of pixel values between a first 
video block and a second search area fbnmed by part of the pixel values stored in step e); 

g) generating motion-compensated pixel values by using the second local motion vector generated in 
step f) and the corresponding pixel values stored In step e); and 

h) generating a difference value between the respective pixel values of the current image stored In 
step b) and the corresponding pixel values of the motion-compensated reference Image generated in 
step g). 

45 12. Amotion compensation encoding method according to claim 11, further comprising the steps of: 

1) generating a first local motion vector on the basis of comparison of the pixel values between the f Iret 
video block which is formed by the pixel values stored in step b) and having a smaller size than that of 
the current Image and a first search area fbnmed by a part of the pixel values stored In step a); 
j) generating the motion-compensated pixel values using the f Iret local motion vector generated in step 

50 i) and the corresponding pixel values stored in step a); and 

k) generating a difference value between the respective pixel values of the current Image stored in step 

b) and the corresponding pbcel values of the motion-compensated reference image generated in step 
J). 

wherein a discrimination result of step c) represents that the current image motion amount Is not 
55 beyond the predetermined motion amount 

13. The motion compensation encoding method according to claim 11 or dalm 12. wherein said step c) com- 
prises the sub-steps of: 
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c1) forming the first search area for motion estimation of the current video block, and including the cur- 
rent video block having a part of the current image pixel values and a part of the pixel values stored in 
step a); 

c2) discriminating whether the reference video block having the same image information as that of the 
current video block exists in the first search area on the basis of comparison of the Image information 
between the current video block pixel values formed in sub-step cl) and the corresponding blocks which 
exist in the first search area and having the same number of pixels as that of the current video block; 
and 

discriminating whether the current Image motion amount is beyond the predetermined motion 
amount on the basis of the discrimination result of sub-step c2). 

14. A motion compensation encoding method according to daim 13, wherein said sub-step c2) further com- 
prises the sub-step of discriminating whether the first reference video block having the same image in- 
formatbn with respect to a plurality of the current video blocks exists in the current Image. 

1 5. Amotion compensation encoding method according to any of claims 11 to 14, wherein said step d) further 
comprises the sub-step of dl) generating the global motion vector o the basis of a mean absolute error 
value according to pixel difference values between a plurality of a respectively moved current image ob- 
tained by movement of the current image within the predetermined motion estimation range and the ref- 
erence image. 

16. Amotion compensation encoding method according to daim 1 5, wherein said sub-step dl) comprises the 
sub-step of dal) calculating the mean absolute error value of the pixel difference values between one cur- 
. rent image by movement using the following equation and the reference Image, 



in which YcurCm, n) represents the (m, n)* pixel value in the cun-ent image, and Yr^m, n) represents 
the (m, n)*** pixel value in the reference image, characters W and H represent the number of horizontal 
and vertical pixels, respectively, and expressions x_rang and y_rang represent a movement range of the 
current image with respect to the reference image in the horizontal and vertical directions, respectively. 

17. Amotion compensation encoding method according to any of claims 11 to 16, wherein step d) further com- 
prises the sub-step of d2) generating the global motion vector on the basis of a mean square error value 
according to pixel difference values between a plurality of a respectively moved current image obtained 
by movement of the current image within the predetermined motion estimation range and the reference 
image. 

18. A motion compensation encoding method according to daim 1 7, wherein said sub-step d2) comprises the 
sub-step of da2) calculating the mean square error value of the pixel difference values between one cur- 
rent image by movement using the following equation and the reference image, 
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mk, 1) = mm Jj^ ^^\ycur^rn^k,n^ 1)-Y,,,{m,n) \K 

-x_rang s k s x_rang-l, 
-y_rang sis y_rang-l 

In which Ycur(m, n) represents the (m. n)*^ pixel value In the cunrent image, and ^r^tn, n) represents 
the (m, n)^ pixel value In the reference image, characters W and H represent the number of horizontal 
and vertical pixels, respectively, and expressions x_rang and y_rang represent a movement range of the 
cunrent Image with respect to the reference Image In the horizontals and vertical directions, respectively. 
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FIG. 3 
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(57) A motion compensating encoding apparatus 
adaptive to a motion amount adaptive ly generates mo- 
tion-compensated pixel values for performing differen- 
tial pulse code modulation of pixel values of a current 
image even when a current image motion amount to be 
motion-compensated with respect to a reference image 
is beyond a predetermined motion amount. The motion 
compensation encoding apparatus includes a global 
motion estimator (53) for generating a global motion 
vector representing spatial position difference between 
the reference image according to the pixel values stored 
in a first memory (17) and the current image according 
to the pixel values stored in a second memory (56), mo- 
tion-compensating the reference image on the basis of 
the generated global motion vector and storing the pixel 
values of the motion-compensated reference image, a 
local motion estimator (54) for generating a local motion 
vector according to comparison of the pixel values be- 
tween a current video block which is formed by the pixel 
values supplied from the second memory (56), and 
which has a size smaller than the current Image and a 
search area formed by part of the pixel values stored in 
the global motion estimator (53), a motion compensator 
(55) for receiving the local motion vector from the local 
motion estimator (54) and generating motion-compen- 
sated pixel values by using the pixel values stored in the 
global motion estimator (53) and the local motion vector, 
and a unit (31 ) for generating a difference value between 
the respective pixel values of each image secondly out- 
put from the second memory (56) and the corresponding 



motion-compensated pixel values output from the mo- 
tion compensator (55). 
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